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Abstract: The main purpose of this paper is to apply and to test the performance of 
a new method, based on belief functions, proposed by Dezert et al. in order to 
evaluate the quality of the individual association pairings provided in the optimal 
data association solution for improving the performances of multisensor- 
multitarget tracking systems. The advantages of its implementation in an illustrative 
realistic surveillance context, when some of the association decisions are unreliable 
and doubtful and lead to potentially critical mistake, are discussed. A comparison 
with the results obtained on the base of Generalized Data Association is made. 
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1. Introduction 


The problem of Data Association (DA) is central in modern multi-target tracking 
(MTT) systems’ design [1, 2]. It is related to the process of associating uncertain 
measurements (observations) to known tracks and is conditioned and motivated by 
the most important function of each surveillance system — to keep and to improve 
target tracks maintenance performance. In the monosensor context it corresponds to 
proper sensor observations partitioning (at a given scan) to the predicted states of 
the targets in such a way, that their tracks’ updates to be as precise, correct and 
reasonable, as much as possible. 

There are several approaches developed to resolve the correlation ambiguities 
and to select the best observation-track pairings, based on different models. Some 
of them establish a reward matrix based on Kinematic only Data Association 
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(KDA) and on a probabilistic framework [3, 4]. Some of them rely on Belief 
Functions (BF) [5-9] and motivate the incorporation of the advanced concepts for 
Generalized Data Association (GDA) [6-8], allowing the introduction of a target 
attribute (target type, radar cross section, etc.) into the association logic, in order to 
improve the track maintenance performance in complicated situations (closely 
spaced/crossing targets), when kinematics data are insufficient for coherent decision 
making. The main characteristics consists in applying Dezert-Smarandache theory 
(DSmT) of plausible and paradoxical reasoning [8] to model and to process the 
utilized attribute data. In the most common case, when the surveillance system 
provides only information kinematic (such as range, azimuth, elevation), obtained 
during a given scan, the most common way of dealing is to solve the optimal DA 
solution and to use all solutions (pairings) to update tracks, even if some of the 
parings have poor quality. It could yields in fact, a bad/wrong track updating, and, 
as a result, the overall tracking performance could be degraded substantially. 

The most recent method proposed by Dezert & Benameur [10] to evaluate the 
Quality Assessment of Data Association (QADA) encountered in multiple target 
tracking applications in a mono-criterion context, and recently extended in [11] for 
the multi-criteria context, deal just with the case above given. It assumes that the 
rewards matrix is known and has been obtained by a method chosen by the user. It 
is based on belief functions for establishing the quality of pairings (interpreted as a 
confidence score) belonging to the optimal data assignment solution based on its 
consistency (stability) with respect to all the second best solutions, provided by a 
chosen algorithm. 

The main purpose of our paper is to serve as a preliminary study of MTT 
performance evaluation based on QADA-KDA approach, and to discuss its 
advantages in an illustrative multi-target tracking scenario. We will make also 
comparison between its performance and the results obtained on the base of GDA. 

The paper is organized as follows. Section 2 describes the problem of DA in 
multitarget tracking context. Section 3 provides details about the new method [10] 
for quality assessment of an optimal DA solution. In Section 4 the simulation 
scenario and results are presented and discussed. A conclusion is given in Section 5. 


2. Data association problem in multitarget tracking context 


Data Association is a very important and most decisive step in the multitarget 
tracking surveillance process. The DA problem consists in finding the global 
optimal assignment of the targets T; i=l, ..., m, to some measurements Zj, 
j=l, ..., n, at a given time k by maximizing the overall gain in such a way that no 
more than one target is assigned to a measurement, and reciprocally. 

The so called mxn rewards (gain/payoff) matrix (=[a@(i, j)] is defined by 


the elements @(i, j) >0, representing the gain of association of the target T, with 
the measurement z;. These elements are usually homogeneous to the likelihood 


ratios. In some cases @(i, 7) >O represent the normalized distances between the 
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measurement jand target i, and in this case DA problem consists in finding the 
best assignment, minimizing the overall cost. 

The goal of the optimal assignment problem is to find a mxn binary 
association matrix A =[a(i, j)], where 


ip 1 if measurement z, is assigned to track T,, 
att, JJ = . 
s 0 otherwise. 


The association matrix maximizes the global reward R(Q, A), given by: 


A m n 
RQ, A)=)) Doli, fai, j). 

i=l j=l 
The importance of the assignment problem is quite clear and various 
successful solutions to its solving already exist. Among the well known are Kuhn- 
Munkres algorithm (known as Hungarian) [12, 13] and its extension proposed by 
Bourgeois and Lassalle in [14] to rectangular matrices. More sophisticated Murty’s 
method [15] provides not only the first best assignment, but also the m-best 

assignments in order of increasing the cost, as shown in the examples of [10, 11]. 

The best optimal assignment solution is not necessarily unique, as well as the 
second best one. Usually in MTT algorithms the first best assignment solution is 
taken as a hard decision for association. But in some real practical cases of dense 
multi-target and cluttered environment, DA problem is difficult to solve, because 
some of the associations decisions a(i, j) are unreliable and doubtful, so they 


could lead to potentially critical mistakes. For example, in case of incorrect 
determination of the incoming measurements for two tracks in such a way, that they 
are too close, the solution of the assignment problem, that is the core of GNN, is 
impossible to be sufficiently explicit. In such a case, it will be more cautious not to 
rely on all the pairings confirmed in the first best solution, but only on some of 
them which are trustable enough, according to the apriori defined threshold level. 
Utilizing the already obtained and available m-best assignments solutions, Dezert et 
al. [10, 11] provide a very efficient method for achieving this important knowledge. 


3. Quality assessment of the optimal DA 


The first and the second best assignment matrices A, and A, are used [10], in 
order to establish the quality of the specific associations (pairings), satisfying the 
condition a,(i, j)=1. The main idea behind QADA method is to compare the 


values a,(i, j) in A, with the corresponding ones a,(i, j) in A, and to identify the 
change (if any) of the optimal pairing (i, j). In our MTT context, (i, j) means that 
the measurement z, is associated with the target 7;. A quality indicator is 


established, depending on both the stability of the pairing and its relative impact on 
the global reward. The proposed method works also when the Ist and 2nd-best 


optimal assignments A, andA,are not unique, i.e., there are multiplicities 
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available. The construction of the quality indicators is based on BF theory and 
Proportional Conflict Redistribution fusion rule No 6 (PCR6), defined within DSm 
theory [8]. 
It depends on the type of the pairing matching in the way, described below: 

e In case whena,(i, j) =a,(i, j) =0, one has a full agreement on the “non- 


association” of the given pairing (i, j) in A, and A, . This “non-association” has no 
impact on the global reward values R (Q, A) and R, (Q, A,), so it will be useless 
to utilize it in DA. Hence, the quality indicator value is set to q(i, j) =0. 

e In case when a,(i, j)=a,(i,j)=1, one has a full agreement on the 
“association” of the given pairing (i,j) in A, andA,. This “association” has 
different impacts on the global reward values R (Q, A) and R,(Q,A,). In order 


to estimate the quality of this matching association, one establishes two basic belief 
assignments (bba), m,(.), s=1,2, according to both sources of information 


(A, and A, ). The frame of the discernment, that one reasons on, consists of a single 
hypothesis X =(7,,z;): measurement z, belongs to track7;. The ignorance is 
modelled by the proposition X U X , where X isa negation of hypothesis X , 
m(X)=a,(i,j). @(i, j)/ R,(Q,A,), 
m (X UX)=1-m,(X). 
Applying the conjunctive rule of combination m (.)&® m, (.) one gets: 
m(X) =m, (X )m,(X) +m (X )m,(X UX) +m (X U X)m, (X), 
m (X UX)=m(X O X)m, (X VX). 


The pignistic transformation [15] is applied in order to obtain pignistic 
probabilities, built on the basis of fused basic belief assignments, such as 


BetPX) =m (X) +$ -mp (X UX) and BetP(X) = 2m, (X UX). Then one 


chooses the quality indicator about the association (T,, z j) as q(i, j) =BetP(X). 

e In case when a,(i, j)=1 and a,(i, j)=0 , then a disagreement (conflict) 
on the association (7;,Z,) in A and A, is detected. One could find the association 
(T,,Z;,) inA,, where j, is the measurement index, such that a, (i, j,) =1. In order 
to define the quality of such conflicting association (7;,z,), one establishes two 
basic belief assignments (bba), m,(.)(s=1,2) according to both sources of 
information (A, and A, ). The frame of discernment, one reasons on, consists of the 
following two propositions: X =(7;,z,), and Y =(7;,z,,). The ignorance is 
modelled by the proposition X UY . Then one obtains: 
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m(X)=a,(i, j). OG, j)/ R(Q, A), 
m(X VY)=1-—m(X); 


m,(Y)=a,(i, j,). @(i, j, )/ R, (Q, A,), 
m, (X UY)=1-m,(Y). 


Different rules of combination (Dempster-Shafer’s, Dubois-Prade’s, Yager’s 
[16] could be chosen to work with a normalized combined BBA. The method [10] 
recommends to use the Proportional Conflict Redistribution rule No 6 (PCR6), 
proposed originally in DSmT framework [8], because it has been proved very 
efficient in practice. With  PCR6, the following fusion result 
Mpcro (-) = M, (.) @ m, (.) is obtained: 


Mpcrs (X) =m (X )m, (X UY) +m) A OC, 
1 2 
mMpcre Y) =m (X V Y)m, (Y) + m Y): a. ; 
1 2 


Mpcre(X UY) =m, (X UY)m, (X VY). 


The decision is taken on the base of the pignistic transformation: 
1 
BetP(X ) = mpegs (X) + a Mpcro(X VY), 
1 
BetP(Y) = mpcrs (Y) + z Mpcr (X UY). 


The quality indicators are chosen as: q(i,j)=BetP(X) and 
q(i, ja) = BetP(Y) . The absolute quality factor becomes: 


Qas (AAS oa i. 4G. J) 


i=l i=l 


4. Simulation scenario and results 


The noise-free multitarget tracking simulation scenario (Fig. 1) consists of three air 
targets moving in parallel from west to east at a constant velocity of 100 m/s and a 
distance between them 150 m. The stationary sensor is located at the origin. The 


sampling period is T pa =5.s and the measurement standard deviations are 0.5 deg 


and 65 m for azimuth and range respectively. The surveillance of moving targets is 
performed during 15 scans. Fig. 2 shows the respective noised scenario. 
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Fig. 1. Noise-free MTT scenario 
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Fig. 2. Noised MTT scenario 

The classical target tracking algorithm was run, consisting of two basic steps: 
(i) data association to associate the proper measurements (distance, angle) with 
correct targets and (ii) track filtering to update the targets state vectors, once the 
optimal assignment was found. In our simulation the Converted Measurement 
Kalman Filter [1] is used. 

In this work we will focus our attention on DA step, which is a very important, 
and the most decisive one in multitarget tracking. The Global Nearest Neighbour 
(GNN) [1] approach is used in order to make a decision for data association. One 
obtains the assignment matrix AMat(i, j),i=1,....m, j=1,...,n, based on the 


normalized distances between measurement j and target i. In order to eliminate 
unlikely (kinematics-based) observation-to-track pairings, the classical validation 
test is carried on the Mahalanobis distance [1, 2] d (i, j) computed from the 


measurement z,(k ) at a given time moment k , and its prediction 2,(k / k —1) : 
A 
(1) d’ (i, j) =(z,(k) —Z(kIk -D'S (k)(z,(k)-2;(k/k -1)) <7. 
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Assuming the given measurement vector’s size to be M , the quantity d 
could be interpreted as a sum of the squares of M independent Gaussian random 


: : 3 SEA ; 2 
variables with zero means and unit standard deviations. For this reason d i have 


Xa distributions with M degrees of freedom and allowable probability of a valid 


observation falling outside the gate. In our case, a probability of 1% is approved, 
then from the table of the chi-square distribution [2] one obtains the threshold 
y =9.21. In fact, this value represents the biggest possible distance value 


associated with the observation-to-track pairings. Based on this, one assumes that if 
j-th measurement does not fall in the gate of target i, then the value, associated with 
this pairing (i, j) in the assignment matrix could be set to be big enough (in our 


case it equals 100), in order to prepare the assignment matrix for the next step. The 
classical Munkres and Katta-Murty methods [15] are used in order to obtain the first 
and the second best assignment solutions for measurement-to-track associations. By 
minimizing the sum of the chosen pairings’ distances, a binary association matrix 


A= [ac : D| is obtained. Fig. 3 shows the typical MTT performance, based on the 


classical GNN approach with Kinematic only DA (KDA), when one does not utilize 
additional procedures to improve the quality of DA. 

In case of noised measurements, it is evident that at scan number 9, tracks 2 
and 3 change their directions, becoming crossing, instead of following their parallel 
moving behavior. It is because of incorrect determination of the incoming 
measurements in such a way, that they are too close and the solution of the 
assignment problem, which is the core of GNN, is impossible to be categorical. The 
problem consists also in the proximity of the targets (inter-distance of 150 m), and 
in the bad sensor distance resolution of op =65m. It leads to a wrong GNN 
association decision. 
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Fig. 3. Typical MTT performance with KDA 


A criterion for a minimal admissible measurements’ distances is chosen here 
as dain < Op / 2 . During scan No 9, one has: dy; < d min- 
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In such a critical case, one needs to utilize some additional information in 
order to avoid associations’ miscorrelations. Here the method in [10] is applied. The 


goal is to estimate the quality of the questionable pairings (7,,z,) and (Jj, z;). 
One obtains the corresponding reward matrix Q = [oti ; D| with elements @(i, j), 
representing the gain of the associations of target T,, i=1,...,m, with 
measurement Z,, j=1,...,n,. It is achieved as Q =[aii, j)] =10- AMat(i, j). 
The reason for this expression relates to the already determined maximal 


normalized distance y =9.21 according to the table of chi-square distribution. The 


data association deals with finding the global optimal assignment of the targets to 
some measurements by maximizing the overall gain in such a way, that no more 
than one target is assigned to a measurement, and reciprocally. This is an equivalent 
measure for optimality, since it is the global minimum of the distances. 

The algorithm, based on [10] was automatically applied during scan No 9, 
because the minimum distance between observations No 2 and No 3 is under the 
accepted limits d(2,3)=15.83m<o,/2. The quality matrix (Table 1) at scan 


No 9, containing the quality levels associated with the chosen pairings in the first 














1 0 0 
best solution A,=|0 1 O/({(%,z,),(G.z,),(%j,.2Z;)}) with respect to the 
0 0 1 
1 0 0 
second best one A4, =|0 O 1} {(%,z,),(Z5.2z;),(%, z,)} is obtained. 
0 1 0 
Table 1. Quality matrix at scan No 9 
Obs/Track 1 2 3 
1 0.773 0.000 0.000 
2 0.000 0.504 0.000 
3 0.000 0.000 0.498 




















It is obvious that according to the first best assignment solution, one has: 
q(7,,.z,) =9.773;  q(T,,z,) =0.504; q(T;,z,;) =0.498. We accept the admissible 
for a correct association quality threshold to be set to qT = 0.7. 


Based on the associations quality assessment (Table 1) and the accepted 
quality threshold qT =0.7, one could make the following decision: The only 


pairing, among those, chosen by Munkres algorithm in the first best assignment is 
(7,,Z,), because its quality level exceeds the accepted reasonable for correct 
association quality threshold q(Z,, z,) =0.773 > 0.7 . Following the decision logic in 
[10], only (7,,z,) pairing will be used in the updating process, while the second 


and the third tracks will keep going under a prediction mode while the next 
measurements will be available, because g(2,2)=0.504<0.7, and 
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q(3,3) =0.498 <0.7. The performance of MTT algorithm, based on the 


QADA-KDA is shown on Fig. 4. 
It is obvious that the reasoned/informed decision taken at scan No 9, based on 
QADA-KDA method leads to a miscorrelation conflict resolution. 
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Fig. 5. MTT performance with GDA 


In order to compare the obtained by QADA result, a simulation was made by 
applying GDA (Fig. 5), when the target attribute (target type) is introduced into the 
association logic, in order to improve the track maintenance performance in the 
same MTT scenario, with an additional assumption, that targets go from west to 
east in a group with the following type order (Fighter, Cargo, Fighter}. 

GDA-MTT improves the process of DA by utilizing target’s type decision 


(based on confusion matrix C=[c,]) coupled with the classical kinematic 


measurements. The way of constructing the confusion matrix is based on some 
underlying decision-making process based on specific attribute features 
measurements. Its elements represent the probability of decisions T, 
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A 
(T, “Fighter, T, = Cargo | that the target type is j when its real type is i: 


c; = P(T, =T,/TrueTargetType =7;) . 


In our simulation 
p = 
C= ; 


0.05 0.95 


GDA is applied at each scan during the whole surveillance process, in order to 
prevent observation-to-track miscorrelations. 


5. Conclusion 


This work is a preliminary study of MTT performance evaluation based on the new 
Quality Assessment of the optimal DA method, proposed by Dezert et al. It assures 
the stability of MTT performance and could be applied in all the cases related to the 
impossibility of DA to produce an association decision with a high quality. It might 
concern the cases, when only kinematics measurements are available, as well as the 
cases when the attribute and kinematic data are both available, because QADA is 
totally independent of the applied logic to obtain the best DA solution. The work 
perspective concerns Monte Carlo based evaluation of different, more critical MTT 
scenarios in a multi-sensor context. 
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